Entropy, dimension, and state mixing in a class of time-delayed dynamical systems 
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Time-delay systems are, in many ways, a natural set of dynamical systems for natural scientists 
to study because they form an interface between abstract mathematics and data. However, they 
are complicated because past states must be sensibly incorporated into the dynamical system. The 
primary goal of this paper is to begin to isolate and understand the effects of adding time-delay co- 
ordinates to a dynamical system. The key results include (i) an analytical understanding regarding 
extreme points of a time-delay dynamical system framework including an invariance of entropy and 
the variance of the Kaplan- Yorke formula with simple time re-scahngs; (ii) computational results 
from a time-delay mapping that forms a path between dynamical systems dependent upon the most 
distant and the most recent past; (iii) the observation that non-trivial mixing of past states can lead 
to high-dimensional, high-entropy dynamics that are not easily reduced to low-dimensional dynam- 
ical systems; (iv) the observed phase transition (bifurcation) between low-dimensional, reducible 
dynamics and high or infinite-dimensional dynamics; and (v) a convergent scaling of the distribu- 
tion of Lyapunov exponents, suggesting that the infinite limit of delay coordinates in systems such 
are the ones we study will result in a continuous or (dense) point spectrum. 
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I. INTRODUCTION 

Experimental, scientific data for which time is an inde- 
pendent parameter is collected in the form of a scalar or 
vector time-series. The vector time-series rarely measures 
all of the independent coordinates required for a full spec- 
ification of the system; the scalar time-series data never 
will. Nevertheless, that even a scalar time-series can be 
used to represent and reconstruct the original dynam- 
ical or natural system from which the data originated 
was a problem addressed well by Takens [l^ , Packard 
et al. [2^, and Sauer et al. [25j. That there exist map- 
pings that can reconstruct the dynamical system from 
observed time-series has also been shown (e.g., Hornik 
et al. |15|). even if the actual reconstruction has proven 
difficult jlSl. [28j . Nevertheless, it is usually time-delay 
dynamical systems that are of prime interest for practi- 
cal analysis of natural systems because they are often the 
dynamical systems closest to real data. In this paper, we 
study discrete-time dynamical systems wth time delays. 
There are, of course, many formulations of time-delay 
dynamical systems; we wish to target and isolate the ef- 
fects associated with adding time-delay coordinates using 
the simplest possible construction (for an alternative, see 
dH, [nl, or [13). To achieve this end, we have struc- 
tured this paper so as to study various extremes that 
are complimented with results for intermediate cases. 
In particular, we consider the dynamics of an iterated 
map and its mixing with a single delay from the distant 
past. Moreover, to isolate and demonstrate the diver- 
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sity among the different mappings, we consider two maps 
whose parameter spaces are diametrically opposed — the 
logistic map, which has dense stable periodic orbits for 
positive parameter values for which it remains bounded; 
and the tent map, which has a unique Sinai- Ruelle-Bowen 
(SRB) measure 30] over a large portion of its parame- 
ter space. It is worth noting that despite this difference, 
these maps are conjugate to one another at least one pa- 
rameter value. A fundamental computational analysis of 
delay dynamical systems as they are used to approximate 
delay differential equations, and the characteristics of the 
diagnostics we will also study is presented in Ref. [llj . 
which provides the best computational background for 
the study we will present in this paper. 

We begin introducing time-delay systems in section HIl 
and the associated diagnostics in section Hill With this 
groundwork laid, we begin the analysis in section llVl with 
an analytical study of both the dynamics and the diag- 
nostics of two extremes — (scalar) mappings dependent 
only on the most recent time-step and mappings depen- 
dent only on a single time-step from the distant past. 
Said differently, we study the dynamics and isolate the 
effects on various standard diagnostics of a simple time- 
rescaling where there is no mixing of states at different 
times. While we will claim some circumstances where the 
delay dynamical systems we study approximate infinite- 
dimensional, continuous spectrum systems, we are also 
interested in isolating the effects of rescaling time and 
adding delay coordinates. In the circumstance when time 
is rescaled, we show that the metric entropy is invari- 
ant to the time-rescaling, the largest Lyapunov exponent 
follows a simple rescaling that is a function of the time- 
delay, and the Kaplan- Yorke dimension formula can pro- 
duce deceiving results. (It is known that as the delay is 
increased, Kaplan- Yorke dimension increases linearly; we 
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will provide insight into why this is so.) The section IVl 
intermediate cases follow via a computational study that 
forms a bridge between the normal and the time-rescaled 
maps. As past states are mixed, for similar reasons that 
allow for the time-series embedding theorems to func- 
tion, the dynamics become much more complicated and 
are not easily reduced to low-dimensional dynamical sys- 
tems. Moreover, as the states are mixed, the results can 
depend on the parity of the number of delays and of- 
ten depend profoundly on the chosen map. Aside from 
studying the effects of adding delay coordinates, it will 
also prove important to study the variation that exists 
over different explicit mappings. To isolate the effects of 
adding delays from the effects dependent on a particular 
mapping, we consider, as previously mentioned, two prac- 
tical extrema among mappings — the tent and logistic 
maps. These maps represent "functional extrema" in the 
sense that the tent map has a unique SRB measure for a 
large, hole- free, open set of parameter values; whereas the 
logistic map has stable, hyperbolic, periodic dynamics for 
a dense set of parameter values [13| . Thus, the tent map 
is extremely dynamically stable in the sense that chaotic 
dynamics is maintained when parameters are changed. 
This is in contrast to the logistic map which, upon pa- 
rameter variation, bears witness to catastrophic changes 
in dynamical behavior realized via the dense stable pe- 
riodic orbit structure in parameter space. Nevertheless, 
we will observe that adding time-delays decreases, in a 
broad sense, the existence of periodic windows even for 
maps that have dense stable periodic windows in their pa- 
rameter space. Moreover, high-entropy, high-dimensional 
geometric structure is observed for non-trivial mixing of 
previous states. 



II. FRAMEWORK 

We address issues related to dynamical systems where 
the present (time-delay-vector) state 

Xt = {xt,Xt-l,Xt-2, - ■ ■ ,Xt-r) 

is dependent upon past states with mappings of the form: 
xt+i = F(xt) 

= iF{xt, ■ ■ . ,Xt-r),Xt,Xt^l, ■ ■ ■ ,Xt-T + l) 

where F,F e C' (r > 0), t e N, xt G R^+\ and Xt € M 
is always bounded. There exist an infinite number of 
ways to combine current and previous states, for instance 
by a simple summation of previous states represented by: 

r 

Xt+1 = F{xt, ■ ■ ■,Xt^r) = ^f3ifi(xt-i) (1) 

1=0 

where f3i £ M. and / e C" (r > 0). One can further 
restrict to the case where fi is identical for all i. One 
nontrivial example worth mentioning where the /^'s are 



not identical, but where _F remains a linear combination 
of previous states, is the standard delayed feedback case 
which can be arrived at by setting /o to a C"" map, (1 — 
Pt)!, and fr — PrXr (see [&] for more information on 
this particular formulation). Note that all of the above 
time-delay dynamical systems are d — t + \ dimensional. 
In this paper we concentrate on the case 

Xt+l^{l~[3)f(xt)+Pf{xt^r) (2) 

for some given / : M R, where r G Z+ is the time 
delay and the scalar (i G [0, 1] is a measure of the relative 
effect of the past on the evolution. With /3 = we have 
the evolution generated by the simple iteration rule 

xt+i = f{xt) (3) 

which corresponds to the standard map with no delays 
(ND), whereas when /? = 1 we obtain what we will call a 
pure delay (PD) system 

Xt+l = fixt-r)- (4) 

A primary question we will address is the nature of the 
change in dynamics of ^ between these two extreme 
(ND and PD) cases as /3 is varied. For /3 G (0,1), © 
has a {t + l)-dimensional state space in the coordinates 
Xt = {xt,xt-i, . . . , xt-r), so it is convenient to view also 
the extreme cases as (r-l- l)-dimcnsional. The system ([5]) 
thus provides a simple background for investigating the 
effect of past information on the dynamics. 

An important motivation for studying the system ([2]) 
comes from synchronization of networks. Indeed, the so- 
called coupled map lattice pTlin the presence of trans- 
mission delays takes the form Q 

xl+i = f{x\)+lr E {f{^l-r)-I{<))^ i = 1, . . . , iV. 

(5) 

Here x\ is the state at time t of the ith member (node) of 
a network of coupled dynamical systems, each of which 
follows the evolution rule ^ in isolation, but interacts 
with its neighbors when coupled to the network. The 
scalar /3 represents the coupling strength. The scalars aij 
are 1 whenever i and j are neighbors and zero otherwise, 
and ki = aij is the degree of node i, i.e., its number of 
neighbors. The nonnegative integer r represents the time 
delay in the information transmission between the neigh- 
bors of the network. It has been shown that the system 
([5]) can synchronize, i.e., \x\ — xl \ ^ as. t ^ oo for all 
V7, even in the presence of a positive transmission delay 
[31 . Then ([5]) asymptotically approaches a synchronous 
solution where x\ = xt for all i. It is easy to see then that 
the synchronous solution xt satisfies In other words, 
([2]) describes the dynamics of the synchronous solutions 
of coupled map lattices in the presence of transmission 
delays. It has been shown that the presence of delays 
greatly enriches the synchronous dynamics, whereas in 
the undelayed case the dynamics of the synchronized net- 
work and the isolated units are identical [1, Q . We inves- 
tigate further aspects of this observation in the following 
sections. 
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III. DIAGNOSTICS 



It follows that 



The primary diagnostic quantities we will use in this 
paper are the Lyapunov characterisctic exponents (LCE) 
and quantities defined by the Lyapunov spectrum, such 
as the metric entropy hfj, and the Kaplan- Yorke dimen- 
sion, DxY 0)[11]- Recall that each Lyapunov exponent 
in the Lyapunov spectrum is given by: 



= lun ^\n\\{{DFYiDF')y/^-v,\ 

t^OO t 



(6) 



where (I?F*)^ is the transpose of the Jacobian _DF* and 
Vj is a basis element of the tangent space (i.e., there are 
d, d-dimensional, mutually orthogonal vectors, each of 
which correspond to basis elements of the tangent space; 
for more information, see 0i[3[lll)- For convenience, 
we will assume that the Lyapunov exponents are mono- 
tonically ordered by index according to Xi ^ Xi+i- I^i 
this work, we utilize the standard algorithm for comput- 
ing the LCEs numerically as is given in Bcncttin et al. [8] 
or Shimada and Nagashima [26|. Furthermore, the met- 
ric entropy is given by the sum of the positive LCEs, 



x.>o 



(7) 



Similarly, the Kaplan- Yorke dimension of an attractor 

mm 

is given by: 



Dry = i + 



H h Xd-j 

IXd-j-i| 



(8) 



where j < d is the largest integer such that Xd 
Xd-j > 0. 



IV. EFFECTS OF A PURE DELAY-TIME 
RESCALING 

The ND and PD cases represent the extrema of Eq. 
(fT|) relative to the p parameters; thus, an understanding 
of both the trivial and PD cases will form a foundation 
for studying Eq. ([T|) and, in particular, Eq. In 
this special case the LCE scalings with d can be handled 
analytically. Thus, the following results apply for f £ 
(r > 1), assuming that / supports a unique SRB measure 
[30j or has robust chaos [j, Q (thus, these results are 
largely independent of a particular choice of /). 

Lemma 1 (Lyapunov spectrum for PD) The Lya- 
punov spectrum of ^ is 



Xi = X2 



Xr+l 



T+V 

where fi is the Lyapunov exponent of f . 



(9) 



Proof. Defining the vector Xf = {xt,Xt-i, . . . , Xt-r) £ 
V~^^, we write Q in vector form 



= {f{xt),f{xt-l), fixt-r))- 



Rescaling time as 



gives 



r + 1 



(11) 



Xt+i = {f{xt-r),Xt, . . . , Xt-r + l)- 



(10) 



(2;(T+l)s+(r+l)j a;(,--|_i)s+,-, . . . , Xi^T-j^i-^s+l) 

= if{X{T+l)s)J{X(T + l)s-l), • ■ • , fiX(T + l)s-T)) 

Finally letting — Xi^T-+i)s-{i-i) for i = l,...,r-|-l, we 
obtain 

. . . , ul+l) = ifiul), f{ul), . . . , /«+!)). 

The last equation describes t+1 decoupled scalar systems 
each of which evolves by the identical rule of the form 
([3|); so it has t+1 identical Lyapunov exponents. In 
view of the applied time scaling pT|) . it follows that the 
Lyapunov exponents of (jlOp are given by Q. 

From Lemma [T] and Eq. ([7]) , the following corollary is 
immediate. 

Corollary 1 (Metric entropy invariant to a PD) 

The standard metric entropy for the pure delay 
system is independent ofr. 

On the other hand. Lemma [T] and Eq. ([8]) imply that 
the Kaplan- Yorke dimension is Dky = d = t + I, which 
yields the following. 

Corollary 2 {Dky is not invariant to a PD) The 

Kaplan- Yorke dimension formula is not invariant to r 
in the pure delay system 

Why is Corollary [2] important? The pure delay system 
(jll) is equivalent to the non-scaled system ^ in every 
way hut the calculated dimension. Moreover, for the PD 
system the "dimension" scales linearly with the delay. 
As we will see, for ^ also, Dky ~ d persists for /? be- 
ing a significant distance from one, and only decreases 
as /3 approaches one-half. But, as we will see, as /? is 
decreased from one or increased from zero, a significant 
change in the dynamics, as quantified by the invariant 
density and the structure of the LCEs, remains unde- 
tected in the dimension calculations. In particular, we 
will see a transition between the trivial high-dimensional 
dynamics of the PD that is easily reducible, and an irre- 
ducible manifestation of high-dimensional dynamics with 
no significant impact seen in Dky versus p. Thus, we 
claim that Dky, and several other dimension estimates, 
can yield deceiving results for some time-delay dynami- 
cal systems because the Dky has an implicit coordinate 
dependence. 



4 



Summarizing, in dynamical systems with a PD that 
has no mixing of states for different times, the largest 
LCE is decreased by the factor that time has been 
rescaled, the metric entropy is invariant to the time- 
rescaling, and the Kaplan- Yorke dimension is equal to 
the factor by which time has been rescaled (i.e., t + 1). 



V. EFFECTS OF STATE-MIXING VIA ADDED 
DELAY COORDINATES 

With the cndpoints (/3 = and 1) fully understood 
we can now begin to piece together the transitional re- 
gion where states are mixed according to Eq. At 
this time a full analytical understanding of this system is 
unavailable. Thus, for what follows, we will be restricted 
to a computational study. Moreover, as previously men- 
tioned, these results, unlike those of the above section, 
will depend on the particular mapping; hence, the reason 
for an investigation using two common but dynamically 
distinct maps, the logistic and tent maps fsTl. 



A. Tent map 

We will begin the computational analysis with the 
standard tent map given by: 



/(^) 



bx if0<a;<l/2, 
b-bx if 1/2 < a; < 1. 



(12) 



at 6 = 2. The first case we will consider is the tent 
map with 49 delay coordinates {d = 50) as this is a good 
intermediate value between the low-d and high-d cases. 
Considering Fig. [l] when / is the standard tent map, 
there is little difference in the qualitative structure of the 
map for d > 4; for d > 4, all dimensional dependence and 
parity disappears (moreover, there do not exist periodic 
windows for d > 3). Nevertheless, when d < 5, there 
is significant dynamical variation as the parameters and 
the number of dimensions are changed. This dynamic 
variation includes the existence of periodic windows in 
the /3-parameter space, dimension parity, and the lack 
of symmetry about (3 = 1/2. This dimensional cutoff is 
likely related to the rate of decay of mutual information 
between xt and Xt-r] however, a precise understanding 
of this "functional" bifurcation is yet to be understood. 

Considering Fig. [21 for ease of description, let us parse 
the /3 interval into three dynamical regions with mono- 
tonic ordering as Bi = (0,0.3), B2 = (0.3,0.7), and 
-B3 = (0.7, 1). The first and third regions are transitions 
to "pure states," where the dynamics correspond to dy- 
namics of the original (tent) map with stochastic pertur- 
bations, or small perturbations of the invariant measure. 
This conclusion is drawn from two observations. First, 
given enough time-delays, the diagnostics {h^ and the 
LCEs) in these regions make smooth transitions to their 
values for the pure states. Note that in region (Fig. [2]), 
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FIG. 1: The dependence of the natural density for ((2]) on the 
delay t. (a) The tent map, (b) the logistic map. /3 = 0.8. 



the LCEs (and thus the entropy and Dky) behave in ac- 
cordance with Lemma[T] The primary difference between 
regions one and three lies in the different LCE structure. 
Nevertheless, considering Fig. [31 the invariant densities 
of both region one and three are very similar (they are 
seemingly identical). Thus, the interpretation of the dy- 
namics in regions one and three is of original map, /, per- 
turbed by what is essentially (but not technically) noise. 
One final bit of support for the claim that regions one 
and three are dynamically similar is the observation that 
for d > 4, the entropy (Fig. [2|) and the invariant density 
(Fig. [3]) are symmetric about (3 — 1/2. 

Region B2, we believe, represents a fundamentally dif- 
ferent kind of dynamics from the other regions. It is not 
a stochastically perturbed low-dimensional system, nor 
does it correspond to a transition to or from the pure 
states in regions Bi or B^. Instead, we claim, based 
originally on work by Manneville [l^ (and a suggestion 
to the authors by Y. Kuramoto) that region B2 is a rep- 
resentation of a continuous (LCE) spectrum, akin to a 



5 




0.2 0.4 0.6 0.8 1 



FIG. 2: Lyapunov exponents for ((T} where / is the standard 
tent map and d = r + 1 = 50. The /3 increments are 10~^, and 
for each /3 the LCEs were calculated over 50000 time-steps. 
The lower subfigure is a zoomed-out version that also shows 
the entropy plot. 



PDE. This hypothesis is driven by the quahtative differ- 
ence in the dynamics that is indirectly witnessed via two 
quahtative observations. Considering the invariant den- 
sity as depicted in Fig. [31 it is evident that the bifurcation 
that occurs between regions one/three and two leads to 
a significantly different invariant density than that of the 
perturbed map in regions one and three. This change in 
the invariant density suggests that there does exist a fun- 
damental, qualitative difference between region two and 
regions one and three. That this qualitative change may 
be independent of dimension above a (soft) threshold can 
be seen in the invariance of the entropy. Considering 
Fig. [51 the entropy is, given d high enough (e.g., d > 20), 
largely invariant to increases in dimension. In particular, 
while the dimension is quadrupled, the change in entropy 
is less than 10-percent and well below error estimates for 
the given number of iterations used in the numerical ex- 
periments. We assert that the variation in the entropy 
for /? > 1/2 is a numerical artifact of the errors in the 
smaller LCEs or the LCEs near zero. 

Quantitative evidence of the existence of a continuous 
spectrum type behavior can be gained via a careful con- 
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1 , , 1 1 , , 1 ^ 
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FIG. 3: The natural density for (O for (a) the tent and (b) the 
logistic maps with delay r = 50. For values of < /3 < 1, the 
vertical strips show the relative density of points in the inter- 
val [0, 1] for the evolution of ([2]), darker shades corresponding 
to higher density. 



sideration of the LCEs as the dimension is increased. In 
particular, considering the plots in Fig. [H where the LCE 
spectrum in region two is displayed for dimensions rang- 
ing from d = 50 to d — 200, normalized to d = 50, the 
following observation is eminent: upon adding delays, the 
LCEs remain distributed in a relatively uniform way up 
to a time-rescaling. In fact, the primary difference in the 
plots at different dimensions is that \xi — Xd\ decreases 
with dimension, and the intermediate LCEs are added 
in a manner consistent with their densities at lower d 
as their numbers are increased. This statement can be 
quantified by considering the normalized distribution of 
positive LCEs. To achieve this, we begin by defining 
M{f3) as the number of positive LCEs at a given /?. Next 
consider the distribution of LCEs, T>, via a discrete plot 
of Xi versus d{^j^) (the factor of d normalizes V to 
unity). As can be seen in Fig. [SI there exists a universal 
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scaling between LCEs that is invariant as d is increased. 
Indeed the least squares fit of 



M{f3) 



ae 



IXi 



(13) 



for c? = 50 yields a = 1.08, 7 = —1.51 (with a x^-error of 
0.978) whereas for d = 200, the fit yields a = 1.02,7 = 
-1.59 (with a x^-error of 0.992). These fits differ by 
less than five percent over a factor of four in dimension, 
and the fitting error decreases considerably with increas- 
ing dimension. That the LCEs remain relatively uniform 
(or are added in a manner consistent with their density 
for lower-d) up to a time rescaling and increase in di- 
mension, implies that increasing the number of delays in 
this region is equivalent to increasing the resolution in 
a PDE-like mapping, leading to the conclusion that as 
d — > 00, the LCE spectrum would tend to a continuous 
function at fixed /3. If one accepts the proposition that 
the "law of large numbers cannot lie," this LCE structure 
is a strong indication of an invariant (SRB) measure for a 
continuous-space system. (An exact qualification of this 
LCE structure is an object of future research). 

The above reasoning leads us to conjecture that sys- 
tems with LCE structure as is seen in Bi corresponds 
to high-entropy, high-dimensional, equilibrium-like (pos- 
sibly turbulent-like) systems that are not easily reduced 
or approximated by low-dimensional dynamical systems. 
Moreover, we believe that the dynamical characteristics 
are largely seen as a consequence of exactly the state 
mixing that allows the time-series embedding results to 
work correctly. It is also interesting that mixing states 
in some (non-trivial) circumstances can lead to a highly 
complicated, high-dimensional dynamical system. In this 
case, state mixing leads to higher-dimensional dynam- 
ics than the initial mapping (in this case the tent map). 
Finally, the dynamics in region B2 can be identified as 
having bifurcation chains structure, which is defined for 
an interval of parameter space such that (i) the number 
of positive LCEs increases with increasing d at a given 
parameter value, (ii) the Euclidean distance between se- 
quential LCE magnitudes decreases with increasing d at 
a given parameter value, (iii) the Euclidean distance be- 
tween sequential LCEs remains relatively uniform at a 
given parameter value, and (iv) the LCEs cross zero 
transversally. Bifurcation chains structure represents a 
highly irreducible, high-dimensional dynamic type rem- 
iniscent of complex, equilibrium-like dynamics (such as 
homogeneous, fully developed fluid turbulence) — the 
bifurcation chains structure is discussed in detail (for a 
different system) in Refs. 0, [I]- 

That regions Bi and B3 consist of similar qualitative 
dynamics, and that these two regions are separated in 
/3-space by region B2 which has qualitatively different 
dynamics, implies that the transition between regions 
Bi and B2, and B2 and B3, represent a sort of bifur- 
cation, or phase transition between "low-dimensional," 
reducible dynamics and high-dimensional dynamics, ir- 
reducible dynamics. For the tent map, this phase transi- 



tion is quite simple and void of highly complex structure. 
As we will see in the following section, this is likely due 
to the fact that the tent map has a nice absolutely con- 
tinuous invariant measure over all the parameters we are 
considering. 

Finally, while we refrain from a careful analysis of the 
dynamics at /3 = 1/2, one is tempted to conjecture that 
this point represents a bifurcation behavior in parame- 
ter space. It is not only the midpoint of B2 and thus a 
turning point of sorts in parameter space, but it is the 
point where Dky begins to drop from equality with d. 
Nevertheless, given that there is no change in the invari- 
ant density of at this point, the bifurcation will have to 
be characterized in a novel manner. It would not be sur- 
prising if a homogeneous function, renormalization style 
analysis could be performed at this point. 



by: 



B. Logistic map 



We now take / to be the standard logistic map given 



f{xt) = axt{l - xt) 



(14) 



with a — A, the parameter setting for which the logistic 
map is absolutely continuous [l3| and is conjugate to the 
tent map. Again, for ease of description, let us parse the 
/3 interval into dynamical regions in monotonic ordering 
as follows: Bi = (0,0.15), B'[_^^ = (0.15,0.2), B2 = 
(0.2,0.8), Bj_,3 = (0.8,0.85), and B3 = (0.85,1). These 
regions correspond to the case presented in Figs. [7] and 
[3] where d is set to 50. It is worth noting that both 
Figs. [1] and [7] display a dimension dependence that does 
not diminish by simply increasing d. 

Just as was the case for the tent map, the first and 
third regions are transitions to "pure states," where the 
dynamics correspond to dynamics of the original (logis- 
tic) map with stochastic perturbations, or small pertur- 
bations of the invariant measure. Again note that in 
region B^ (Fig. [7]), the LCEs (and thus the entropy and 
Dry) behave as per Lemma [T] There is indeed little 
difference between the logistic and tent maps in these 
regions, which suggests that these regions will exist and 
be qualitatively the same for most stochastically stable 
(20| dynamical systems if d is large enough. The dynam- 
ics seen in regions one and three is evidence that points 
to the logistic (for certain parameters) and tent maps 
being stochastically stable and satisfying L.-S. Young's 
zero-noise limit l3C|. 

Region B2 is most easily seen by considering either 
the invariant density in Fig. [3] (where the invariant den- 
sity changes little between regions Bf^2 ^-i^d -Bj_^3 yet is 
qualitatively distinct from regions Bi and -B3), or the 
LCE spectrum in Fig. [7] where the bifurcation chains 
structure appears. Indeed, region B2 is roughly the same 
for the logistic and tent maps, and we impart a similar 
interpretation of the dynamics. Nevertheless, there are 
important differences. For lower dimensions, the logistic 
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FIG. 5: Metric entropy plots of Eq. ^ where / is the stan- 
dard tent map for dimensions ranging from 30 to 200. The /9 
increments are 10~*, and for each /3 the LCEs were calculated 
over 100000 time-steps. 
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FIG. 4: LCE plots of Eq. ([1} where / is the standard tent 
map restricted to region two (^2) for dimensions ranging from 
50 to 200 where the d > 50 cases have been rescaled (by d/50) 
to the d = 50 time-scale. The /3 increments are 10"'*, and for 
each /3 the LCEs were calculated over 100000 time-steps. 



FIG. 6: The distribution of LCEs — Xi versus d 
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for 



Eq. IT} where / is the standard tent map with dimensions 50 
and 200 at fixed /3 = 1/2. 
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FIG. 7: LCE plots of equation ([1} where / is the standard 
logistic map and d = 50 (top two plots) and d = 51 (bottom 
plot). The f3 increments are 10~*, and for each /3 the LCEs 
were calculated over 50000 time-steps. 



map does display small periodic windows in region two, 
as can be seen in Fig. [51 The state mixing combined with 
added dimensions appears to have the effect of destroying 
the stable periodic orbits if d is large enough — periodic 
orbits are observed for d < 30, whereas for d > 50, if 
they exist, they are below the f3 resolution of 10~^. It is 
possible that the difference between the logistic and tent 
maps is a combination of the fact that the logistic map 
does not have persistent dynamics relative to parameter 
perturbations (i.e., the existence of dense, stable periodic 
orbits for a G [0,4]) contrasted with the relative dynam- 
ical persistence of piecewise smooth maps [6^ such as the 
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FIG. 8: Entropy versus (3 where / is the standard logistic 
map with a varying number of delays. 



tent map. 

The f -dependence appears profoundly in the phase 
transition regions, Bf^2 ^'^d ^i^-^a- The structure of the 
transitional regions between the low-dimensional "pure 
states" and the high-dimensional dynamics of region B2 
are particular to the logistic map. In particular, both 
regions correspond to an effective value of the parame- 
ter Oeff G (3.23,3.45) (where acs = max{/3a, (1 — /3)a}), 
which corresponds to the region between the bifurcation 
from a fixed point to period two, but before the bifurca- 
tion from period two to period four, of the logistic map. 
The boundaries of these regions are roughly independent 
of magnitude of the dimension (as can be seen by consid- 
ering the entropy versus dimension shown in Fig. [8|) , but 
these regions do have a dimension parity dependence. 
Assuming d > 4, region Bj_^^ is never a periodic win- 
dow independent of the dimension parity. In contrast, 
region Bf^2 is not a periodic window when d is odd but 
is always a periodic window when d is even. Moreover, 
while the width of regions Bf^2 ^-^^d Bj^^ are roughly 
equivalent and symmetric about (3r — 1/2, they have dif- 
ferent shapes and structures. This implies that if ^ is a 
random variable with the invariant measure of /(a;t_r), 
both f{xt) + v ^ fixt + v) and f[xt) + v ^ f{xt-r) + 
when / is the logistic map. (In contrast to the logistic 
map, it appears that the time-ordering does not matter 
for the tent map.) 



VI. SUMMARY 

Putting all the pieces together, for the time-delay sys- 
tems ([2]) and ([4]), if the number of dimensions, d — t -I- 1, 
is large enough, entropy remains roughly invariant to in- 
creases in d while the LLE, the LCEs, and Dxy do not. 
While the LLE and LCEs can still yield insight into the 
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global structure of the attractor, many dimension calcu- 
lations such as the Kaplan- Yorke dimension may yield 
deceiving results. We conjecture this is in general true 
for systems of the form largely because dimension 
calculations have an implicit dimension- and thus coor- 
dinate dependence. Because of these issues, it is likely 
that diagnostics such as the metric entropy or the sta- 
tistical complexity which are truly independent of 
coordinates, will be more useful for showing equivalence 
and difference in time-delay dynamical systems. Beyond 
the analysis of the diagnostics used to describe and in- 
vestigate time-delay systems, we also demonstrated that 
both the time unsealed map with elements of the dis- 
tant past and the time rescaled map with the elements of 
the current state produce roughly similar dynamics rem- 
iniscent of the 1-d map plus noise. But, as the distant 
past and current states are mixed in more equal parts, 
the mixing of states only separated with time-delays can 
give rise to high-dimensional, irreducible, chaotic dynam- 
ics that we claim can approximate a PDE-like system if 
the mixing is via nearly equal contributions of states, 
and there exist enough degrees of freedom manifested as 
time-delays. Thus, we demonstrate two distinct classes of 
dynamics: one where the dynamics represent an infinite- 
dimensional system; and one where the dynamics repre- 
sent a finite-dimensional system, with a phase transition 



(bifurcation) between the two dynamical classes, all in 
the simple context of mixing only two states of a single 
mapping. Moreover, this PDE-like dynamics produces a 
great deal of dynamic stability even for mappings that 
have a lot of periodicity without delays; thus the non- 
trivial state mixing can produce relatively stable chaotic 
dynamics over a sizable interval in parameter space. We 
hypothesize that this dynamic stability (persistence of 
chaos) occurs when the delay times allow for enough de- 
correlation between the active (non-zero) terms of Eq. ^ 
to mix states in a non-linear, but non-random-like man- 
ner. Nevertheless, the dynamics are dependent on the 
original maps that compose the time-delay. Finally, in 
[3] and [H, an example of bifurcation chains structure 
was presented that, relative to a measure on a function 
space, was persistent to parameter perturbations. More- 
over, in these examples, in the presence of the bifurcation 
chains structure, the probability of periodic windows de- 
creased as dimension increased. Here we observe similar 
results, but note that the bifurcation chains alone do not 
imply stability or lack of periodic windows as can be seen 
via the middle plot of Fig. [T] 
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